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A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS. 
WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 
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Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to communication(s) filed on 06 July 2006 . 
2a)S This action is FINAL. 2b)n This action is non-final. 

3) n Since this application is in condition for allowance except for fomnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1 935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) E1 Claim(s) 1-49 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) S Claim(s) 1-49 is/are reiected. 
?)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)0 The drawing(s) filed on is/are: a)n accepted or b)n objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 
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application from the International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 



1 , This action is responsive to communications: amendment filed 7/6/2006, to the original application filed 
3/8/2000. IDS filed 3/8/2000, 6/18/2000, 1/25/2005, 1/31/2005, and 10/18/2005. 



Claim Rejections - 35 USC § 103 
2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set 
forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 102 of this title, if the 
differences between the subject matter sought to be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which said subject matter pertains. Patentability shall 
not be negatived by the manner in which the invention was made. 



3. Claims 1-49 are rejected under 35 U.S.C. 103(a) as being unpatentable over Moran et al. 
(hereinafter Moran), U.S. Patent No. 5,717,879 issued February 1998 (cited on Applicant's mS), in view 
of Ludwig et al. (hereinafter Ludwig), U.S. Patent No. 5,802,294 issued September 1998, and further in 
view of Adler et al. (hereinafter Adler), U.S. Patent No. 6,249,765 issued June 2001. 



in regard to independent claim 1, Moran teaches management of meeting related information (i.e. 
recording of meeting information) (Moran Abstract, Figures 12-14; compare with claim 1 'A method for 
managing information during a meeting comprising steps of), 

Moran teaches recording/replay of records of a meeting (Moran Abstract, column 3 lines 33-39, Figures 
11-14; compare with claim 1 "recording activities among participants during said meeting to produce recording 
meeting data:''). 



Application/Control Number: 09/521,252 
Art Unit: 2176 



Page 3 



Moran teaches identifying a participant directive via accessing meeting data via button events initiated 
by participants during an ongoing meeting, the event indicators being color coded to identify a participant, with 
each button event indicative of a directive, as well as buttons and notes (i.e. a service - indicating a participant 
who feels something significant is being discussed) (Moran column 22 Hnes 1-20, Figure 13). Moran does not 
specifically teach identifying said directive via ''analyzing said recorded meeting data .... while said meeting is 
ongoing" (although participants can contribute to Moran 's Figure 13 during a meeting, Moran is moot regarding 
actually showing Figure 13 to participants for analysis during an ongoing meeting). However, Ludwig teaches a 
teleconferencing system comprising a video mosaic of each participant (Ludwig, Abstract, Figure 8A to 8C — 
also note button "Whiteboard" within Figure 8B). Ludwig shows multiple participants in a common interface. 
During a teleconference meeting, said participants are commonly shown to all other participating callers, 
therefore Ludwig displays an interface of running meeting data for analysis. It is noted that Ludwig' s invention 
can utilize whiteboard, and annotation capabilities, and sessions can be recorded (Ludwig column 3 lines 1-10). 
It would have been obvious to one of ordinary skill in the art at the time of the invention to apply Ludwig to 
Moran, providing Moran the benefit of showing ongoing meeting data (Figure 13) to participants as a meeting is 
ongoing, for analyzing purposes (compare with claim 1 '^analyzing said recorded meeting data.., by a 
participant of said meeting**). 

It is further noted that Moran teaches a "Liveboard" which is disclosed as an electronic whiteboard (see 
Moran column 12 lines 58-65). Since electronic whiteboards facilitate collaboration between users regarding a 
simultaneously displayed document (a "shared representation" - see Moran column 14 lines 16-20), the 
changing of an object, or adding of an annotation message via buttons etc. (see also Moran column 14 lines 45- 
67) can be interpreted as a participant directive initiated during said meeting on said displayed document. As the 
directive occurs, Moran's Liveboard software detects (without direct human intervention), records and displays 
the (now recorded) directive for all users to see (during the Liveboard meeting). 

Moran teaches button events initiated by participants during an ongoing meeting, the event indicators 
being color coded to identify a participant, with each button event indicative of a directive (i.e. indicating a 
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participant who feels something significant is being discussed), resulting in addition of the event to the 
recording (Moran column 22 lines 12-20, Figures 1 1, 13). Moran also teaches Figure 13 item 1302, which is an 
added note associated with a speaker (see also Moran column 22 lines 8-12) (compare with claim 1 '7/z response 
to identifying said participants . . . during said meeting. 

Moran does not specifically teach analyzing recorded meeting data ''absent direct human intervention'' 
to identify contained cues. However, Adler teaches an automatic (without direct human intervention) method of 
extracting pertinent data from audio messages (i.e. voicemail, etc.) (Adler Abstract). Adler's invention 
automatically analyzes a recorded message for cue words (i.e. name, number, etc.) and extracts the related data, 
such as a phone number from said message. The data alone can then be played back, or used as indices within a 
database (pointers to the data are stored with said message) (Adler Abstract, column 15 lines 12-23, column 16 
lines 3-18, 25-30, 50-62, column 17 lines 30-37, 50-59). Since it is typical for a user to leave his/her telephone 
number (or name, etc.) as a cue for the recipient to make note of, this teaching can be fairly interpreted as cues 
intended as participant directives. It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply Adler to Moran, providing Moran the benefit of automatic event indicators without 
distracting the meeting participants. 

In regard to dependent claim 2, Moran teaches tracks 1 122-1 124, which are starting points of (textual 
notes of participants. Since said notes are part of the recorded meeting, said text is analyzed (as explained 
above) in association with a button press (track 1 124) (see Moran column 22 lines 8-25). 

In regard to dependent claim 3, Moran teaches both audio and video (Moran column 21 lines 25-34, 
column 22 lines 20-25, Figures 11-14). 
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In regard to dependent claim 4, Moran teaches adding notes (a form of editing/manipulation) to 
recorded meeting data (Moran Figure 13 item 1302) 

In regard to dependent claim 5, Moran teaches accessing recorded meeting data via button events 
initiated by participants during an ongoing meeting, the event indicators being color coded to identify a 
participant, with each button event indicative of a directive (i.e. indicating a participant who feels something 
significant is being discussed) (Moran column 22 lines 12-20). 

In regard to dependent claim 6, Moran teaches a meeting using human participants, audio, video, 
textual notes, and prepared material via a projected medium (Moran column 13 lines 1-1 1,18-20, Figure 13). 

In regard to dependent claim 7, Moran teaches accessing recorded meeting data via button events 
initiated by participants during an ongoing meeting, the event indicators being color coded to identify each 
participant, with each button event indicative of a directive (i.e. indicating a participant who feels something 
significant is being discussed — adding a note, accordingly) (Moran column 22 lines 12-20, Figure 13). 

In regard to dependent claim 8, Moran teaches a meeting player for recording locations of 
participants, said locations recorded as part of the recorded media to be analyzed for adding directives, 
accordingly (as explained in the rejection of instant claim 1, above) (Moran Figure 14). 

In regard to dependent claim 9, Moran teaches a meeting player for recording locations of 
participants, said locations recorded as part of the recorded media to be analyzed for adding directives, 
accordingly (as explained in the rejection of instant claim 1, above), each participant is shown in a different 
geographic location relative to one another (Moran Figure 14). 
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In regard to independent claim 10, Moran teaches management of meeting related information (i.e. 
recording of meeting information between participants) (Moran Abstract, Figures 12-14; compare with claim 10 
''A method for managing information services during a meeting involving two or more participants, comprising 
steps of). 

Moran teaches recording/replay of records of a meeting utilizing a (continuous timestream) of video, 
said video can comprise a person (i.e. a participant) standing to speak, said timestream enabled for an entire 
meeting (Moran Abstract, column 3 lines 33-39, column 22 lines 20-24 Figure II item 1 125). Moran does not 
specifically teach said video of a participant as continuously recorded for the duration of said meeting. However, 
Ludwig teaches a teleconferencing system comprising a video mosaic of a live conference call, with a video of 
each participant presented for the duration of said call (Ludwig, Abstract, Figure 8B, 8C — also note button 
"Whiteboard" within Figure 8B). It is noted that Ludwig' s invention can utilize whiteboard, and annotation 
capabihties, and sessions can be recorded (Ludwig column 3 lines 1-10). It would have been obvious to one of 
ordinary skill in the art at the time of the invention to apply Ludwig to Moran, providing Moran the benefit of a 
complete video record of each participant for reference purposes (compare the above to claim 10 **producing a 
continuous video recording of at least one of said participants for the duration of said meeting"), 

Moran teaches producing an audio timeline for each participant for the duration of a meeting (Moran 
Figure 1 1 items 1 1 19, 1 120, 1 121; compare with claim 10 ''producing a continuous audio recording of at least 

one of said participants for the duration of said meeting'*). 

Moran teaches storing video/audio streams (Moran column 12 lines 45-50, column 31 lines 4448; 
compare with claim 10 ''storing said video and said audio recordings in a data store"), 

Moran teaches identifying a participant directive via accessing meeting data via button events initiated 
by participants during an ongoing meeting, the event indicators being color coded to identify a participant, with 
each button event indicative of a directive, as well as buttons and notes (i.e. a service - indicating a participant 
who feels something significant is being discussed) (Moran column 22 lines 1-20, Figure 13). Moran does not 
specifically teach identifying said directive based on video/audio data (although participants can contribute to 
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Moran's Figure 13 during a meeting, Moran is moot regarding actually showing Figure 13 to participants for 
analysis during an ongoing meeting). However, Ludwig teaches a teleconferencing system comprising a video 
mosaic of each participant (Ludwig, Abstract, Figure 8A to 8C — also note button "Whiteboard" within Figure 
8B). Ludwig's shows multiple participants in a common interface. During a teleconference meeting, said 
participants are commonly shown to all other participating callers, therefore Ludwig displays an interface of 
running meeting data for analysis. It would have been obvious to one of ordinary skill in the art at the time of 
the invention to apply Ludwig to Moran, providing Moran the benefit of showing ongoing meeting data (Figure 
13) to participants as a meeting is ongoing, as well as the benefit of recording comments based upon live 
recorded video feeds from participants in other areas (compare with claim 10 "analyzing either or both of said 
video recording and said audio recording.... detect a participant directive'', and ''providing one or more 
information-related services based on said participant directive''). 

Moran teaches button events initiated by participants during an ongoing meeting, the event 
indicator being color coded to identify a participant, with each button event indicative of a directive (i.e. 
indicating a participant who feels something significant is being discussed, as indicated via gestures and 
utterances of a participant), resulting in addition of the event to the recording, Moran also teaches Figure 13 item 
1302, which is an added note associated with a speaker (see also Moran column 22 lines 8-12) (Moran column 
22 lines 12-20, Figures 1 1, 13 compare with claim 10 ''thereby providing information... during said meeting"). 

Moran does not specifically teach analyzing recorded meeting data "absent direct human intervention" 
to identify contained cues. However, Adler teaches an automatic (without direct human intervention) method of 
extracting pertinent data from audio messages (i.e. voicemail, etc.) (Adler Abstract). Adler's invention 
automatically analyzes a recorded message for cue words (i.e. name, number, etc.) and extracts the related data, 
such as a phone number from said message. The data alone can then be played back, or used as indices within a 
database (pointers to the data are stored with said message) (Adler Abstract, column 15 lines 12-23, column 16 
lines 3-18, 25-30, 50-62, column 17 lines 30-37, 50-59). Since it is typical for a user to leave his/her telephone 
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number (or name, etc.) as a cue for the recipient to make note of, this teaching can be fairly interpreted as cues 
intended as participant directives. It would have been obvious to one of ordinary skill in the art at the time of the 
invention to apply Adler to Moran, providing Moran the benefit of automatic event indicators without 
distracting the meeting participants. 

In regard to dependent claim 11, Moran teaches an input (i.e. recording/capturing) device (Moran 
column 6 lines 35-39, colmnn 13 lines 1-1 1). 

In regard to dependent claim 12, Moran does not specifically teach detecting directives based upon 
text in video or audio. However. Ludwig teaches teleconferencing whereby a textual note is added to a 
participant's data feed (Ludwig Figure 28 — lower left window). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to apply Ludwig to Moran, providing Moran the benefit of 
participants reacting to textual data for effect. 

In regard to dependent claim 13, Moran teaches accessing recorded meeting data via button events 
initiated by participants during an ongoing meeting, the event indicators being color coded to identify a 
participant, with each button event indicative of a directive (i.e. a service indicating a participant who feels 
something significant is being discussed — based upon the context of said meeting) (Moran column 22 lines 12- 
20). 

In regard to dependent claim 14, Moran teaches accessing recorded meeting data via button events 
initiated by participants during an ongoing meeting, the event indicators being color coded to identify a 
participant, with each button event indicative of a directive (i.e. a service - indicating a participant who feels 
something significant is being discussed). The note is attached to the recorded meeting accordingly, and 
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information is retrieved to be displayed on an editor, utilizing the continuous timelines, accordingly (Moran 
column 22 lines 12-20, Figures 11-14). 

In regard to dependent claims 15-17, Moran teaches accessing recorded meeting data via (input) 
button events initiated by participants during an ongoing meeting, the event indicators being color coded to 
identify a participant, with each button event indicative of a directive (i.e. a service - indicating a participant 
who feels something significant is being discussed). The note is attached to the recorded meeting accordingly 
and information is retrieved to be displayed for users, accordingly (Moran column 22 Unes 12-20, Figures 11- 
14). 

In regard to dependent claims 18-19, Moran teaches accessing, editing, and assimilating information 
(Moran Figure 8, 1 1-14, especially Figure 13 item 1302). Moran does not specifically teach establishing a new 
participant, transmitting/receiving messages, and accessing various networks. However, Ludwig teaches a 
teleconferencing system utilizing resume, hang up, and adjourn buttons, as well as electronic mail and various 
networks (i.e. LANAVAN etc.) (Ludwig Abstract, Figures 2A, 2B, SA— SC, column 15 hnes 17-31). It would 
have been obvious to one of ordinary skill in the art at the time of the invention to apply Ludwig to Moran, 
providing Moran the benefit of teleconferencing a meeting. 

In regard to dependent claims 20-21, Moran does not specifically teach permissions, as claimed. 
However, Moran teaches accessing recorded meeting data via button events initiated by participants during an 
ongoing meeting, the event indicators being color coded to identify each participant, with each button event 
indicative of a directive (i.e. a service - indicating a participant who feels something significant is being 
discussed (Moran column 22 lines 12-20), providing the claimed equivalent of permissions, since (implicit) 
permission is granted to assign a certain colored button for use by a specific participant. It would have been 
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obvious to one of ordinary skill in the art at the time of the invention to interpret Moran in this fashion, 
providing Moran the benefit of increased security (and organization) to its recorded meeting. 

In regard to dependent claim 22, Moran teaches a meeting player showing participants in distinct 
geographic locations (Moran Figure 14). 

In regard to independent claim 23, claim 23 reflects the system comprising computer executable 
instructions used for performing the method as claimed in claim 10, and is rejected along the same rationale 

In regard to dependent claims 24, 25, claims 24, 25 reflect the system comprising computer 
executable instructions used for performing the method as claimed in claim 14, and are rejected along the same 
rationale. 

In regard to dependent claims 26, 27, 28, 29, 30, 31,32, claims 26, 27, 28, 29, 30, 31, 32 reflect the 
system comprising computer executable instructions used for performing the method as claimed in claims 121, 
22, 18, and are rejected along the same rationale. 

In regard to independent claim 33, claim 33 incorporates substantially similar subject matter as 
claimed in claims 10, 12, 14, and is rejected along the same rationale. 

In regard to dependent claims 34, 35^6,37, claims 34, 35, 36, 37 incorporate substantially similar 
subject matter as claimed in claims 10, 14, 17 and are rejected along the same rationale. 

In regard to dependent claims 38-41, claims 38-41 incorporate substantially similar subject matter as 
claimed in claims 10, 20-22, and are rejected along the same rationale. 
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In regard to independent claim 42, claim 42 reflects the system comprising computer executable 
instructions used for performing the method as claimed in claims 10, 12. 14, 15, and in further view of the 
following, is rejected along the same rationale. 

Moran teaches storage of audio, image, and textual related information (Moran Figures 1 1-14). 
Moran does not specifically teach real-time video and audio. However, Ludwig teaches a 
teleconferencing system, said system used in real-time (Ludwig Abstract, Figures 8 A - 8C). It would have been 
obvious to one of ordinary skill in the art at the time of the invention to apply Ludwig to Moran, providing 
Moran the benefit of real-time data for use in conference meetings. 

In regard to dependent claims 43-46, claims 43-46 reflect the system comprising computer executable 
instructions used for performing the method as claimed in claims 20, 21, 13, 14, and are rejected along the saint 
rationale 

In regard to dependent claims 47-49, claims 47-49 reflect the system comprising computer executable 
instructions used for performing the method as claimed in claims 17, 18, 22, and are rejected along the same 
rationale. 

Response to Arguments 

4. Applicant's arguments filed 7/6/2006 have been fiiUy and carefully considered but they are not 
persuasive. 

Applicant argues on page 12 of the amendment that Moran teaches a system for capture and playback of 
recording data representing collaborative activities, such as meetings, to recall conversations and/or other 
activities, etc., and that Moran has nothing to do with managing information during a meeting as presently 
claimed (page 12-13 of amendment). The examiner respectfully disagrees. Moran teaches "Liveboard", which is 



Application/Control Number: 09/52 1 ,252 Page 1 2 

Art Unit: 2176 

disclosed as an electronic whiteboard. As is known in the art, whiteboards facilitate simultaneous user 
collaboration as applied to a simultaneously displayed document. As a user makes a change (i.e. an annotation), 
said change is made available to other users at substantially the same time for interaction. It is respectfully 
submitted that Moran's Liveboard can operate substantially in this fashion. Moran records a meeting "live" (as it 
is occurring). Its Liveboard functions in a collaborative activity to provide a "shared representation" in which 
each user can view and interact with (see Moran column 14 lines 16-19). While Moran discloses unique features 
directed to subsequent playback of a meeting, nevertheless a typical meeting is usually recorded "live". Notes 
(participant directives) are defined by Moran as notes taken by meeting participants (Adam and Charlie - see 
Moran column 22 lines 8-19). It is well within reason that participants can initiate notes, button depressions, etc. 
while a meeting is ongoing. It is also noted that the claims do not recite what a participant directive is, other than 
"an action on said information desired to be initiated during said meeting". A participant wanting his/her 
message known to others can be reasonable interpreted accordingly. Ludwig (also disclosing a "whiteboard") is 
used be forcefully teach interaction as a meeting occurs and is recorded. 

Regarding Applicant's arguments directed to the examiner's interpretation of claimed "cues", "an action 
on information... etc.", the examiner's interpretation of Moran's "visual indicator", etc. (page 14-15 of 
amendment), it is respectfully noted that Applicant does not appear to clarify what a "cue" or an "action. . .etc." 
is. Without further clarification in the instant claims, it is respectfully submitted that button activation, and the 
Liveboard' s automatic detection and processing of said button activation, can be reasonable interpreted as a cue 
and an action to be performed (i.e. displaying a message). 

Regarding Applicant's arguments directed to the Ludwig reference, it is respectfully noted that Ludwig 
is primarily used to forcefully teach displaying ongoing interaction accordingly. Both Moran and Ludwig teach 
whiteboards. 

Conclusion 

5 . TmS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy as set forth 
in 37 CFR 1.136(a). 
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A shortened statutory period for reply to this final action is set to expire THREE MONTHS fi-om the 
mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this 
final action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated fi-om the mailing date of the advisory action. In no 
event, however, will the statutory period for reply expire later than SIX MONTHS fi-om the mailing date of this 
final action. 

6. Any inquiry concerning this communication or earlier communications fi^om the examiner should be 
directed to William L. Bashore whose telephone number is (571) 272-4088. The examiner can normally be 
reached on 1 1 :30am - 8:00pm EST. 

If attempts to reach the examiner by telephone are unsuccessfiil, the examiner's supervisor, Heather 
Hemdon can be reached on (571) 272-4136. The fax phone number for the organization where this application 
or proceeding is assigned is 571-273-8300. 

7. Information regarding the status of an application may be obtained fi"om the Patent Application 
Information Retrieval (PAIR) system. Status information for published applications may be obtained fi^om 
either Private PAIR or Public PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business Center (EBC) at 



866-217-9197 (toll-fi-ee). 




WILLIAM BASHORE 
PRIMARY EXAMINER 



September 29, 2006 



